AD-A071  112 


UNCLASSIFIED 


SOUTHERN  ILLINOIS  UN IV  CARBONDALC  DEFT  OF  MATHEMATICS  F/t  11/1 

APPROXIMATION  WITH  EXPONENTIAL  SUMS.(U) 

79  OH  KAMMLER  AF0SR-7A-1683 


I W I 

A<?7M22 


8 -79 


AO  A 0 7 1 1 2 2 


r 


V ’ J 


afosr-tr. 


APPROXIMATION  WITH  EXPONENTIAL  SUMS 


(USAF  Grant  No.  74-2653) 


Submitted  to:  Dr.  Robert  N.  Buchal 

Directorate  of  Mathematical  and 
Information  Science 

Air  Force  Office  of  Scientific  Research/NM 
Bldg.  410 

Bolling  Air  Force  Base 
Washington,  D.C.  20332 


Submitted  by:  David  W.  Kammler,  Professor 
Department  of  Mathematics 
Southern  Illinois  University 
Carbondale,  Illinois  62901 


Period  Covered  By  This  Report:  1 March  1974  - 28  February  1979 


Approved  ror  public  release  , 

distribution  unlimited. 


VJo 


1 


I 


INTRODUCTION 

\ 

r 

In  the  study  of  many  physical  and  biological  phenomena 
we  encounter  situations  where  we  wish  to  approximate  a given 
function  F by  a sum  of  exponentials 

-A-,t  -At 

(1)  Y(t)  * aj_e  + . . . + ane 

or  by  a more  general  exponential  sum  Y which  satisfies  some 
differential  equation 

(2)  Y(n)(t)  + bnY(n'i;)  (t)  + ...  +b2Y^13(t)  + bjY(t)  = 0 
along  with  certain  initial  conditions 

(3)  Y(l_1) (0)  = c±  i = 1,  . . . , n. 

The  objective  is  to  find  Y such  that 

|{ F - Y ||  = min 

where  |[  ||  is  the  Lp-norm  associated  with  some  given  measure 
dy(t)  on  [0,  °°)  . The  goal  of  this  project  has  been  to 
investigate  this  important  problem  in  nonlinear  approxi- 
mation theory,  i.e.,  to  consider  questions  of  existence, 
unicity,  characterization,  etc.,  and  to  devise  and  test 
numerical  methods  for  finding  a best  approximation  Y when 
F is  specified  by  means  of  a formula  or  through  sampled  data. 

An  enormous  simplification  in  the  characterization  and 
construction  of  best  approximations  occurs  when  the  class  of 
functions  F is  suitably  restricted.  It  is  well  known  that 
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certain  naturally  occurring  growth  and  decay  processes  can 
be  modeled  exceptionally  well  with  a sum  of  exponentials. 
One  might  try  to  characterize  an  "ideal  growth  function" 
G(t)  by  requiring  it  to  be  very  smooth  (i.e.,  to  have 
derivatives  of  all  orders)  and  to  have  the  property  that 
G,  G',  G",  ...  never  take  negative  values.  Likewise,  an 
"ideal  decay  function"  F(t)  would  be  the  time  reversal  of 
an  "ideal  growth  function"  and  thus  have  the  properties 
that 


F € C°°(0,  oo ) 

(-l)kF(k)(t)  > o,  0 < t < »,  k « 0,  1,  2,  ...  . 

Such  an  "ideal  decay  function"  F is  said  to  be  completely 
monotonic.  A detailed  study  of  the  approximation  of  com- 
pletely monotonic  functions  by  sums  of  exponentials  thus 
is  of  immediate  use  in  the  modeling  of  both  decay  and  growth 
processes . 

During  the  course  of  the  grant  a total  of  13  research 
papers,  one  technical  report,  and  one  doctoral  dissertation 
were  produced  by  the  principal  investigator,  Dr.  David  W. 
Kammler,  and  by  his  graduate  student  Dr.  Robert  J.  McGlinn 
who  was  supported  in  part  with  grant  funds.  A listing  of 
these  research  works  and  a brief  nontechnical  discussion 
of  their  significance  is  given  below. 


3 


RESEARCH  PAPERS  PRODUCED  UNDER  THE  GRANT 


[1] 

[2] 

[3] 

[4] 

[5] 

[6] 

[7] 

[8] 

[9] 

[10] 

[11] 

[12] 


D.  W.  Kammler,  An  alternation  characterization  of  best 
uniform  approximations  on  non  compact  intervals, 

J.  Approximation  Theory,  16^(1976),  pp.  97-104. 

D.  W.  Kammler,  Approximation  with  sums  of  exponentials 
in  LD[0,°°),  J.  Approximation  Theory,  16(1976), 
pp.  *384-408. 

D.  W.  Kammler,  Chebyshev  approximation  of  completely 

monotonic  functions  by  sums  of  exponentials,  SIAM 
J.  Numer.  Anal.,  1_3  (1976)  , pp.  761-774. 

D.  W.  Kammler,  Prony's  method  for  completely  monotonic 
functions,  J.  Math.  Anal.  Appl.,  5_7  (1977)  , pp. 
560-570. 

D.  W.  Kammler,  Existence  of  good  and  best  approximations 
on  unbounded  domains  by  exponential  sums  in  several 
independent  variables,  J.  Approximation  Theory,  21 
(1977)  , pp.  215-223  . 

D.  W.  Kammler  and  R.  J.  McGlinn,  A bibliography  for 

approximation  with  exponential  sums,  J.  Comp.  Appl. 
Math.,  4(1978),  pp.  167-173. 

R.  J.  McGlinn,  Uniform  approximation  of  completely  mono- 
tone functions  by  exponential  sums,  J.  Math.  Anal. 
Appl.  <T5(1978),  pp.  211-218. 

D.  W.  Kammler,  Numerical  evaluation  of  exp(tA)  when  A 
is  a companion  matrix,  SIAM  J.  Numer.  Anal., 

L5 (1978)  , pp.  1077-1102. 

D.  W.  Kammler,  - Approximat ion  of  completely  monotonic 
functions  by  sums  of  exponentials,  SIAM  J.  Numer. 
Anal.,  1^6  (1979),  pp.  30-45. 

R.  J.  McGlinn,  Approximation  by  exponential  sums  on  dis- 
crete and  continuous  domains,  J.  Approximation 
Theory,  2_5(1979)  , pp.  65-88. 

R.  J.  McGlinn  and  D.  W.  Kammler,  Local  conditioning  of 
parametric  forms  used  to  approximate  continuous 
functions,  Amer.  Math.  Monthly,  8_6(1979)  , to  appear. 

D.  W.  Kammler,  Least  squares  approximation  of  completely 
monotonic  functions  by  sums  of  exponentials,  SIAM 
J.  Numer.  Anal.  1_6(1979)  , to  appear. 


4 


[13]  D.  W.  Kammler  and  R.  J.  McGlinn,  An  alternative  to 
Prony ' s method,  in  preparation. 


TECHNICAL  REPORT  PRODUCED  UNDER  THE  GRANT 

[14]  D.  W.  Kammler  and  R.  J.  McGlinn,  A Family  of  FORTRAN 
Programs  for  Finding  Best  Chebyshev  Approxima- 
tions with  Applications  to  Exponential  Sums, 
Southern  Illinois  University,  Carbondale,  Illi- 
nois, 1975,  187  pp. 


DISSERTATION  PRODUCED  UNDER  THE  GRANT 

[15]  R.  J.  McGlinn,  Approximation  by  Exponential  Sums, 

Ph.D.  Dissertation,  Southern  Illinois  University, 
Carbondale,  Illinois,  1976. 


MAJOR  ACCOMPLISHMENTS 


One  major  accomplishment  of  the  study  has  been  the 
devising  of  a very  general  theory  for  establishing  the 
existence  of  a best  approximation  to  an  arbitrary  function 


F by  an  exponential  sum  of  a given  order.  In  [2]  the  theory 
was  extended  from  the  case  where  du(t)  = dt  on  [0,1]  to 
where  du(t)  = dt  on  [0,«>),  and  in  [10]  a further  extension 
was  made  to  the  case  of  an  arbitrary  measure  du(t)  on  [0,°°) 
(so  as  to  allow  for  ^-approximation  on  discrete  subsets). 

In  this  latter  case  it  was  necessary  to  augment  the  set  of 
exponential  sums  with  certain  pseudo  exponential  sums  to 
avoid  the  irregular  endpoint  conditions  associated  with  some 
measures  du(t).  A related  extension  of  [2]  to  establish 
the  existence  of  best  Lp-approximations  to  a given  F by 
exponential  sums  in  several  independent  variables  is  given 
in  [5]. 
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A second  major  accomplishment  has  been  the  development 
of  an  efficient  numerical  scheme  for  evaluating  an  exponen- 
tial sum  Y (b , c,  t)  when  the  parameters  b^  = (b^,  b^)  , 

c = (c^,  cn)  and  t of  (2)-(3)  are  given.  If  Y is 

real  valued,  the  parameters  b^,  c^  are  all  real  even  when 
the  characteristic  roots  A-^,  An  of  (2)  are  complex, 

and  (unlike  (1))  this  parametric  form  does  not  change  when 
the  characteristic  roots  coalesce.  The  algorithm  uses  a 
preprocessing  step,  a series  evaluation,  and  repeated 
squarring  to  numerically  e\aluate  the  matrix  exponential 
exp(tA)  where  A is  the  companion  matrix  associated  with  (2). 
Each  step  exploits  the  companion  matrix  structure  of  A so 
as  to  make  the  algorithm  both  fast  and  accurate.  The  al- 
gorithm is  presented  in  detail  in  [8]  along  with  a detailed 
error  analysis  and  the  results  of  extensive  numerical  test- 
ing on  carefully  chosen  model  problems.  A numerical  study 
of  the  conditioning  of  this  parametric  form  is  given  in  [14], 

A third  (and  perhaps  the  most  important)  accomplishment 
has  been  the  creation  of  a mathematical  theory  and  workable 
numerical  methods  for  constructing  best  Chebyshev,  least  mean, 
and  least  squares  approximations  for  a given  completely 
monotonic  function  F by  sums  of  exponentials.  Such  an 
optimal  approximation  Y always  exists  (even  when  du(t)  is 
discrete)  and  has  the  form  (1)  with  0 < A^  < ...  < AR  and 
with  a^  > 0,  i * 1,  ...,n  (except  when  F has  the  form  (1) 
with  some  a^  = 0 or  when  the  support  of  du(t)  has  less  than 
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2n  points).  The  characterization  of  a best  approximation 
leads  to  interesting  interpolation  theorems  which  involve 
exponential  sums  in  the  case  of  Chebyshev  and  least  mean 
approximation  and  which  involve  the  transform 

00 

f/(s)  = s Y(t)e'stdu(t) 

0 

for  least  squares  approximation.  A Remez  type  algorithm 
together  with  a homotopy  process  for  solving  the  associated 
nonlinear  interpolation  problem  have  been  coded  and  used 
to  construct  best  Chebychev  approximations  on  finite  and 
semi - inf inite  intervals  and  on  discrete  point  sets. 

Quadratically  convergent  descent  algorithms  have  been 
devised,  studied,  coded,  and  tested  for  constructing  best 
least  mean  and  least  squares  approximations.  The  results 
are  presented  in  detail  in  [3],  [4],  and  [7]  (for  Chebyshev 
approximations),  in  [9]  (for  least  mean  approximations) 
and  in  [12]  (for  least  squares  approximation). 

A fourth  major  accomplishment  has  been  the  compilation 
and  publication  [6]  of  a bibliography  for  approximation  with 
exponential  sums.  This  will  undoubtedly  be  of  enormous 
value  to  others  working  in  the  area. 

ORAL  PRESENTATIONS 

Most  of  the  research  findings  published  in  the  above  papers 
were  first  announced  by  Dr.  Kammler  during  talks  given  at 
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various  professional  meetings.  A listing  of  these  oral 
presentations  is  given  below. 


[1]  "Approximation  with  exponential  sums  in  Lp[0,°°]," 

Society  of  Industrial  and  Applied  Mathematics  National 
Meeting,  California  Inst,  of  Technology,  June,  1974. 
Abstract:  SIAM  Review,  16^,  (Oct.,  1974),  p.  583. 

[2]  "Chebychev  approximation  of  completely  monotonic 
functions  by  sums  of  exponentials,"  American  Mathe- 
matical Society  Winter  Meeting,  Washington,  D.C., 

Jan . , 1975 . 

Abstract:  Notices  of  A.M.S.  2_2  (1975),  pp.  A161-162. 

[3]  Invited  participant,  Air  Force  Office  of  Scientific 
Research- - Rome  Air  Development  Command  Joint  Confer- 
ence on  Temporal  Mode  Techniques  for  Target  Classifi- 
cation, Griffiss  Air  Force  Base,  New  York,  October, 

1975. 

[4]  "Numerical  evaluation  of  exp(tA)  when  A is  a companion 

matrix,"  Society  of  Industrial  and  Applied  Mathematics 
National  Meeting,  San  Francisco,  California,  Dec.,  1975. 
Abstract:  SIAM  Review  18_,  (1976)-  p.  811. 

[5]  "An  error  analysis  for  the  improved  squaring  method  for 
computing  exp(tA)  when  A is  a companion  matrix," 

Society  of  Industrial  and  Applied  Mathematics  National 
Meeting,  Atlanta,  Georgia,  Oct.,  1976. 

[6]  "L^-approximation  of  completely  monotonic  functions  by 
sums  of  exponentials,"  Society  of  Industrial  and  Applied 
Mathematics  National  Meeting,  Albuquerque,  New  Mexico, 
November,  1977. 

Abstract:  SIAM  Review  20^,  (1978),  p.  628. 

[7]  "Least  squares  approximation  of  completely  monotonic 
functions  by  sums  of  exponentials,"  Society  of  Indus- 
trial and  Applied  Mathematics  National  Meeting,  Knoxville, 
Tenn. , October,  1978. 

Abstract:  SIAM  Review  2_1  , (1979),  to  appear. 


eEC  j««TV  ri  OSSIFICATION  OF  THIS  PAGE  (When  Data  t’ntered) 

r'T"^ 


jreFort  documentation  page 


-f — . 


HK AD  INSTRUCTIONS 
HF.FORK  COMPLETING  FORM 


! ■ rtf  anHT 

/^AFOSR 

#rST  79-^759 

|2.  GOVT  ACCESSION  NO. 

- 

3.  RECIPIENT’S  CATALOG  NUMBER 

'(  ' 1 

5 TYPE  OF  REPORT  & PERIOD  COVERED 

(?~  Approximation  With  Exponential  Sums  r ) f ■ J ’ _ 4-  / 

I yl/Lew-.  r^r._4 


■KTinfrCR 


J F*  (: 27. 


1 


7.  authors; 
David  VJ 


7 


Kammler 


9.  performing  organization  name  ano  address 
Dept  of  Mathematics 
Southern  Illinois  University 
CArbondale,  Illinois  62901 


II.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

Air  Force  Office  of  Scientific  Research/NM 

20332 


Bolling  AFB,  Washington,  D.C. 


13.  NUMBER  OF  PAGES 
8 


14  MONITORING  AGENCY  NAME  4 ADDRESSf//  dllloront  Irom  Controlling  Ollico) 


) 1 1 


15.  SECURITY  CLASS,  (of  this  report) 

UNCLASSIFIED 


15*.  DECL  ASSI  F|  CATION/ DOWN  GRADING 
SCHEDULE 


16  DISTRIBUTION  ST  ATEMENT  (of  this  Report) 

Approved  for  public  release;  distribution  unlimited, 


• 7 DISTRIBUTION  ST  iEnT  (of  ' • abstract  entered  In  Block  20,  ll  different  from  Report) 


ie  supplement  ary  tes 


19  KEY  WOROS  ( Continue  on  reverse  tide  if  neceaaary  and  Identify  by  block  number) 


pO  13  5 ^ 


20  ABSTRACT  ( Continue  on  reveraa^aide  If  neceaaary  and  Identify  by  block  number) 

During  the  courseNof  the  grant  a total  of  13  research  papers,  one  technical 
report,  and  one  doctoraiNdissertat ion  were  produced  by  the  prinicipal  investigator 
and  his  graduate  student.  One  major  accomplishment  has  been  the  devising  of  a 
very  general  theory  for  establishing  the  existence  of  a best  approximation  to  an 
arbitrary  function  by  an  exponential  sum  of  a given  order.  A second  result  was 
the  creation  o^rsathematical  theory  and  workable  numerical  methods  for  construct-! 
Ing  best  Chebyshev,  least  mean,  and  least  squares  approximations  for  a given 
completely  monotonic  functon  by  sums  of  exponentials.  Finally,  the  (.compilation  . 

V/.v 

c*  ^ . 


DD  , 1473 


UNCI.ASSTFTKD 


tnrrj  A oq  T^T  rT> 


